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In this paper it is shown how standard linear programming techniques 
can be applied to designing finite impulse response digital filters. Attention 
is concentrated on designing filters having exactly linear phase, and arbitrary 
magnitude response. The design method is illustrated by examples of the 
design oj frequency sampling filters with constraints on in-band ripple, 
optimal filters where the passband and stopband cutoff frequencies may 
be specified exactly, and filters with simidtaneous constraints on the time 
response and frequency response. 

I. INTRODUCTION 

Many techniques exist for designing digital niters using optimization 
procedures. Herrmann and Schuessler have designed equiripple error 
approximations to finite impulse response (FIR) lowpass and bandpass 
filters using nonlinear programming procedures. 1 " 2 This work has been 
extended by Hofstetter, Oppenheim, and Siegel, 3 and by Parks and 
McClellan 4 to solve for the desired filters using polynomial interpolation 
techniques. Rabiner, Gold, and McGonegal 5 used a steepest descent 
technique to obtain FIR digital filters with minimax error in selected 
bands with the constraint that only a few of the filter coefficients were 
variable. Steiglitz, 6 and Athanasopoulos and Kaiser 7 have used non- 
linear optimization techniques to obtain recursive filter approximations 
to arbitrary frequency response specifications. 

Recently, attention has been focused on the use of linear programming 
techniques for the design of digital filters. 8-10 Many digital filter design 
problems are inherently linear in the design parameters, and hence 
are natural candidates for linear programming optimization. Further, 
linear programs are easy to implement and are generally guaranteed 
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to converge to a unique solution. The rate of convergence of the pro- 
grams is moderately fast, thus making this technique practical for 
problems with 100 parameters or so. 

There are many areas of FIR filter design where linear programming 
can be used conveniently. These include: 

(i) design of filters with minimax ripple in the passband and/or 

stopband; 
(ii) design of optimal (minimax) absolute or relative error ap- 
proximations to arbitrary frequency response characteristics, 
where the passband and stopband edge frequencies of the 
filter may be specified exactly; 
(Hi) design of two-dimensional filters of the frequency sampling 

type, or with optimal error approximation; 
(iv) and design of filters with simultaneous constraints on char- 
acteristics of both the time and frequency response of the 
filter. 
Several of these design areas have been examined and examples will 
be presented showing how to apply linear programming techniques 
in specific cases. In the next section, the general framework of linear 
programming is presented and several practical aspects of linear pro- 
grams are discussed. The following sections show how the general FIR, 
linear phase, filter design problem is linear in either the filter impulse 
response coefficients, or equivalently the Discrete Fourier Transform 
(DFT) coefficients, and how this problem is solved in specific cases. 

II. LINEAR PROGRAMMING 

The general linear programming problem can be mathematically 
stated in the form: find {X,}, j = 1, 2, • • • , N subject to the con- 
straints: 

X,-^0, j= 1,2, ••• ,N; (1) 

2 c,.,.X,. = b< , i = 1, 2, • • • , M(M < N); (2) 

such that: 

N 

y^ GjXj is minimized. (3) 

i-i 

The above problem is referred to as the "primal problem" and by a 
duality principle can be shown to be mathematically equivalent to 
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the "dual problem": find {F,}, i = 1, 2, • • • , M subject to the con- 
straints: 



such that: 



ZcuF, ^O/i j = 1,2, ■■■ ,N, (4) 



^ b.F,- is maximized. (5) 



The remainder of this paper refers to the dual problem as this is the 
most natural form for the digital filter design problems under con- 
sideration. 

One characteristic of linear programs is that, given there is a solution, 
it is guaranteed to be a unique solution; and there are several well 
defined procedures for arriving at this solution within (M + N) itera- 
tions. There are also straight-forward techniques for determining if 
the solution is unconstrained or poorly constrained. 

The next section shows that linear phase FIR filters are linear in 
the design parameters and hence can be optimally designed using 
linear programming techniques. 

III. LINEAR PHASE FIR FILTERS 

Let {/&„}, n = 0, 1, ■■ • , N — 1 be the impulse response of a causal 
FIR digital filter. The requirement of linear phase implies that 

K - />„-„-! . (6) 

The filter frequency response can be determined, in terms of the {h„}, 

as: 

H(e iaT ) = l!v- fc . (7) 

n = 

For the case where N is odd, eq. (7) can be combined with eq. (6) 
to give: 

H(fi ioT ) = e~ iuHN - 1)/2)T 



linear phase 
term 



■ [*■-"■ +T 2/, - c ° 8 [((V)-"H] 



purely real 
linear in {/?„} 
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Equation (8) shows H(e iuT ) to consist of a purely linear phase term 
corresponding to a delay of ((JV — l)/2) samples, and a term which is 
purely real and linear in the impulse response coefficients. It is the 
second term in eq. (8) which is used for approximating arbitrary mag- 
nitude response characteristics. Where N is even, the result of eq. (8) 
is modified to: 



r((,v/2)-n /N — 1 \ "I 

H(e i-^ = g-,- M «y-i)/.)r ^ £ 2/ln coe ^—-— _ n j wr J . 



(9) 



linear phase 
term 



purely real 
linear in { h„ } 



Equation (9) shows that for N even, the linear phase term corresponds 
to a delay of an (integer + £) number of samples. The center of sym- 
metry of [K] is midway between samples (N/2) and (N/2 - 1). The 
remainder of eq. (9) is again a real term which is linear in the impulse 
response coefficients. 

The DFT relation can be used to show that the filter frequency 
response is also a linear function of the DFT coefficients [H k \. It is 
derived elsewhere 11 that the frequency response of linear phase FIR 
filters can be written: 



oNT 



sin 



H(e iaT ) = e 



-joT((JV-])/2) 



N 



H n 



- E 



/ -\krr t 1"/C . U>T 

K (-1) H k 4: cos^rsm — 



sin -z- I cos iol — cos -rs- 



(10) 



when 



K = < 



(N - l)/2 for N odd 

N 



- 1 



for N even 



The significance of eq. (10) is that the frequency response of a linear 
phase FIR filter is linear in the [H k ] as well as in the [h n \ ; hence linear 
programming techniques can be used to optimize the values of all or a 
selected set of DFT or impulse response coefficients. 
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IV. DESIGN OF FREQUENCY SAMPLING FILTERS 

Previously, design of frequency sampling filters was accomplished 
using a steepest descent minimization. 5 This technique was capable 
only of minimizing the peak out-of-band ripple when several DFT 
coefficients in a transition band between passbands and stopbands 
were varied. Another limitation of the technique was that the amount 
of computation it took to optimally choose the variable DFT coefficients 
grew exponentially with the number of unconstrained variables. The 
largest problems attempted had four coefficients variable. This problem 
is readily solved in a much more general form using linear programming 
techniques. Furthermore, the computation required to calculate the 
more general solutions is considerably less than for the steepest descent 
algorithm used previously. 

A typical specification for a lowpass filter to be approximated by a 
frequency sampling design is shown in Fig. 1. The heavy points show 
the DFT coefficients, and the solid curve shows the interpolated fre- 
quency response. The passband edge frequency is F r and the stopband 
edge frequency is F 2 . Since the length of the filter impulse response 




FREQUENCY 



Fig. 1 — Typical specification for a frequency sampling lowpass filter with transi- 
tion coefficients 7\ , 7'« . 
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is N samples (assume N even), there are (N/2 + 1) DFT coefficients 
(called frequency samples) to be specified. Those DFT coefficients 
which are in the passband are arbitrarily assigned the value 1.0, and 
those that fall in the stopband are assigned the value 0.0. The DFT 
coefficients in the transition band are free variables, and are labeled 
Ti , T 2 in Fig. 1. The approximation problem can be set up as a linear 
program in the following manner. We let 

T 3 = peak stopband ripple. 

Then the design problem consists of finding values of (7\ , T 2 ) to satisfy 
the constraints: 

(i) The in-band ripple is less than or equal to some prescribed 

tolerance, e. 
(ii) The peak out-of-band ripple, T 3 is to be minimized. 
Mathematically this problem can be stated as: find (7\ , T 2 , T 3 ) subject 
to the constraints: 

1 - t ^ F(co) + 2 r,0(«, i) £ 1 + e, ^ co g 2irF, , (11) 



-T 3 ^ F(co) + E TiDfa, i) ^ T 3 , 2ttF 2 ^ co ^ irF. , (12) 
t=i 

where F(u>) is the contribution of the fixed DFT coefficients (the 
1.0's in-band) and D(co, i) is the contribution of the ith variable tran- 
sition coefficient and is of the form shown in eq. (10), and F, is the 
sampling frequency. 

A suitable reshuffling of terms in eqs. (11) and (12) puts the set of 
equations in the form of the dual problem of linear programming. 
The final equations are of the form: find (T x , T 2 , T 3 ) subject to the 
constraints: 



£ T { D(u, i) £ 1 + e - F(co) 

-SW.0 ^ - 1 + « + *•(«) 
i=i 

E^DCc^o-r, ^ -F(«) 

t=i 

- E r,z>(«, *) - r 3 ^ F( w ) 
i=i 

(— T 3 ) is maximized. 



^ co ^ 27tF! , (13) 



.2ttF 2 ^ co ^ ttF. , (14) 
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The inequalities of eqs. (13) and (14) are evaluated at a dense set of 
frequencies in the appropriate range of interest (an 8-1 interpolation 
between DFT coefficients is sufficient) to yield the necessary set of 
equations for the linear program. 

V. RESULTS ON FREQUENCY SAMPLING DESIGNS 

A wide variety of frequency sampling filters has been designed 
using the results of eqs. (13) and (14). Previously, using the steepest 
descent algorithm, constraints on the in-band ripple, e, could not be 
maintained. 5 With the linear programming design, tradeoff relations 
between in-band and out-of-band ripple can be obtained for a fixed 
number of transition samples, or equivalently a fixed width of tran- 
sition band. Such tradeoff relations are illustrated in Figs. 2 and 3 
for two and three transition samples.* In both these figures, the log 
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Fig. 2 — Tradeoff relations between S t and 5 2 for lowpass frequency sampling 
filters with two variable transition coefficients. 



* The varying nature of the curves of Figs. 2 and 3 is due to the variance in the 
measured points (heavy dots) as a function, of filter bandwidth. Solid curves are 
shown as an underbound and overbound on the typical behavior of the tradeoff 
relations. 
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Fig. 3 — Tradeoff relations between 5i and 5 2 for lowpass frequency sampling 
filters with three variable transition coefficients. 



of out-of-band ripple, 5 2 , versus the log of in-band ripple, 5, , is plotted. 
Figure 2 shows that for in-band ripples larger than about 0.03 (i.e., 
20 logio 5, greater than —30 dB), the out-of-band ripple is in the range 

— 66 to —71 dB. These figures correspond to the cases designed earlier 5 
when no constraint on in-band ripple was in effect. At the other extreme 
of the curve, the out-of-band ripple flattens to between —25 and —30 
dB with the in-band ripple, 5i , in the range 0.0002 to 0.0005 (-74 to 

— 66 dB). The midrange of the curve shows the tradeoff" attainable 
between the two ripples. Figure 3 shows similar results for the case 
of three transition samples. No simple explanation is available for the 
general shape of these curves or the differences between the data in 
Figs. 2 and 3. 

Figure 4 shows a comparison between equiripple filters and frequency 
sampling designs for the specialized case where in-band ripple and 
out-of-band ripple are equal. In this figure the normalized width of 
transition band* is plotted as a function of log 5, where 5 is the ripple. 

* The normalized width of transition band is defined as D = N[(F 2 — Fi)/F s ] 
where N is the impulse response duration, F s is the sampling frequency, and Fi and 
F 2 are the passband and stopband cutoff frequencies in Hertz. 
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-20 
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Fig. 4 — A comparison between the curves of normalized transition bandwidth 
versus 5 for equiripple filters and frequency sampling filters. 

For the frequency sampling designs, the normalized transition widths 
are 4, 3, and 2 corresponding to 3, 2, and 1 transition samples. At 
these normalized transition bandwidths the ripple is —66, —50, and 
— 32 dB respectively. The equiripple designs attain the same ripple 
values at normalized transition bandwidths of approximately 3.7, 
2.6, and 1.4. The percentage difference in transition bandwidth for 
the 3 cases is 8.1, 15.4, and 42.9. Thus, except for the I transition 
point case, the transition bandwidths for frequency sampling designs 
are reasonably close to the bandwidths for equiripple filters. 



VI. DESIGN OF OPTIMAL FILTERS 

Just as a few of the DFT coefficients in a transition band could be 
varied to design reasonably efficient frequency sampling filters, all 
of the DFT coefficients, or equivalently all of the impulse response 
coefficients could be varied to give an optimal* approximation to 
any desired frequency response. Similar optimal approximations have 
been designed previously using nonlinear optimization procedures 1,2 

* The filters being discussed in this section are optimal in the sense of the theory 
of Chebyshev approximation on compact sets (i.e., the error of approximation 
exhibits at least [(iv + l)/2] + 1 alternations (of equal amplitude) over the frequency 
ranges of interest). In most cases, all the peaks of the error function are of the same 
amplitude, therefore, these filters are often referred to as equiripple filters. 
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and by polynomial interpolation methods. 3,4 However, the use of 
linear programming techniques, although significantly slower in running, 
offers many advantages over other existing design procedures. The 
design procedure is guaranteed to converge within a fixed number of 
iterations. Critical frequencies of the desired response can be specified 
exactly. The programs converge over a very wide range of parameter 
values. Finally, with the existence and increased understanding of 
integer linear programming techniques, the design problem can be 
combined with the coefficient quantization problem to design optimum 
filters with a prescribed wordlength. 

To see how the design of optimal linear phase filters can be accom- 
plished using linear programming techniques, consider the design of 
a lowpass filter to meet the following set of specifications: 

Stopband magnitude ripple ±8 2 \ minimized or 

Passband magnitude ripple ifij specified 

Passband edge FA specified 

Stopband edge F»j specified 

F t < F 2 
(Phase response is to be linear.) 

In this example either 81 , or 8 2 , or some linear combination is min- 
imized. One can also consider the situation where 5, and 5 2 are pro- 
portionally related (i.e., 5, = M, 5 2 = M where fc, and fc 2 are constants, 
and 5 is minimized). In this manner a constant ratio between pass- 
band and stopband ripple is maintained. Consider the case where 5„ 
is specified, and 5 2 is minimized. The linear program which realizes 
the above specifications can be stated as: find {/*„}, 5 2 subject to the 
constraints*: 

(W-D/2 



-ho- 2 



/»o + 2 



(iV-l)/2 

E h 

71=1 

(iv-n/2 

E K 



coawnT ^ — 1 + 5i 



^ 0} g 2ttF x 



cos unT — 6 2 ^ 



(AT-D/2 

— ho — 2 E h n cosconT — 

n=l 

(— 8 2 ) maximized. 







2irF 2 ^ u ^ irF, 



(15) 



(16) 



* From this point on, for convenience, we are assuming h„ is defined from ( — (N — 
l))/2 ^ n ^ {N — l)/2, and is symmetric around n = 0. Since N is odd, eq. (8) 
can be simplified to the form: H(e<" T ) = h + E< = r 1)/2 2h " cos <-> nT - 
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Before proceeding to typical designs, it is important to note some 
properties of linear programming problems, and show how they affect 
the optimal filter design problem. The solution to a linear programming 
problem of the type shown above with L variables, and M inequality 
constraints occurs when at least L of the 71/ equations are solved with 
equality (instead of inequality); the remaining inequalities being met 
with inequality. For the optimal filter design problem this implies that 
there are at least L frequencies at which the ripple obtains a maximum. 
The practical implications of this result are best illustrated in Fig. 5 
which shows the frequency response of an equiripple optimal filter 
with passband ripple 5, , stopband ripple 6 2 , passband edge frequency 
Fx , and stopband edge frequency F 2 . The length of the filter impulse 
response is N samples. If 



7V P = number of ripples in the passband, and 
N, = number of ripples in the stopband, 



then 



N, + N, ^ 



(# + 1) 
2 



(TV odd), 



(17) 



since an JVth degree polynomial (the z-transform of the filter impulse 
response) has at most (N + l)/2 points of zero derivative in the fre- 
quency range from to F,/2 Hz. In addition to attaining a maximum 




Fs/2 



Fig. 5— A typical frequency response for an optimal filter, defining N,, , the number 
of passband maxima, and N. the number of stopband maxima. 
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value at each of the ripple frequencies, the error attains a maximum 
value at / = F, and at / = F 2 (i.e., at the edges of the transition band). 
In fact this is how the transition band edges are denned. Thus the 
number of error maxima, N, , satisfies the inequality 



N < gLta + 2 . 

2 



(18) 



The number of variables N v in the linear program of eqs. (15) and (16) is 

_ (AMii) + j (19) 

2 

where (N + l)/2 coefficients of the impulse response are variable, and 
one ripple coefficient is variable. Thus eq. (19) shows that the minimum 
number of error maxima from the linear program solution, although 
optimal, is one less than the maximum number of error maxima ob- 
tainable.* A discussion of the effects of the extra ripple peak on the 
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Fig. 6 — The impulse and step response for an optimal digital filter with a 99- 
point impulse response. 

* Parks and McClellan 4 have labeled the cases where all the ripples are present 
as "extra ripple" designs. 



IMPULSE RESPONSE DIGITAL FILTERS 



1189 



width of the transition band is given by Hofstetter, et al." For all 
practical purposes the loss of the extra ripple is negligible in terms of 
normalized transition bandwidth, etc. At this point it is worthwhile 
showing some results of the design procedure. 

VII. OPTIMAL FILTER DESIGNS-LOWPASS FILTER EXAMPLES 

Using the linear program of eqs. (15) and (16), filters were designed 
with impulse response durations of up to 99 samples. Figures 6 and 7 
show plots of impulse and step responses, and the log magnitude re- 
sponse of a lowpass filter designed from the specifications: 
In-band ripple 5 

Out-of-band ripple 5 

Passband edge frequency 808 Hz 
Stopband edge frequency 1111 Hz 
Sampling frequency 10000 Hz. 




2000 3000 

FREQUENCY IN HZ 



5000 



Fig. 7 — The frequency response of an optimal digital filter with a 99-point impulse 
response. 
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The minimum value of 8, as chosen by the linear program, was 8 = 
0.001724 or -55.3 dB. 

Figure 8 shows a comparison of the normalized transition bandwidth 
versus log 5 2 for Herrmann-Schuessler equiripple filters with the 
maximum number of ripples, and the optimal linear program filters. 
The solid line in this figure shows the Herrmann-Schuessler data for 
5, = S 2 , and the data points show the linear program data for several 
values of N, the impulse response duration. Clearly the differences 
between the data are insignificant as stated earlier. (The data points 
which fall below the solid line in Fig. 8 are due to the error in representing 
the equiripple data by a straight line on these coordinates.) 

VIII. OPTIMAL FILTER DESIGNS-OTHER EXAMPLES 

As stated earlier, the linear programming technique can design 
optimal approximations to any desired frequency response. To illustrate 
this feature several full band differentiators 13 and several filters for 
use in a digitized version of the A-channel bank 14 (a frequency trans- 
mission system in use in the Bell System) were designed. 

To design a full band differentiator H(e iaT ) must approximate the 
normalized response, 

ftO = iA. (20) 

,2 



z 

< 3 



O 1 



O N =49 

□ N = 25 

HERRMANN-SCHUESSLER A N = 99 

5, = fi 2 




-120 -100 -80 -60 -40 -20 

20 LOG, (5 2 ) IN DECIBELS 

Fig. 8 — A comparison between the curves of normalized transition bandwidth 
versus 5 for equiripple filters with the maximum number of ripples, and optimal 
filters with one ripple omitted. Normalized bandwidth is defined as D = N(F* — 
F t )/F t . 
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where (a>,/2) is half the radian sampling frequency. To get an optimal 
error approximation requires, 

-5 ^ \H(e iuT ) - H(e iuT ) \ ^ 8, (21) 

where 5 is minimized. To get a purely imaginary frequency response 
as in eq. (20), the impulse response is required to satisfy the symmetry 
condition, 

N 
h n = -//,v-„_, , n = 0,1, ■■■,— - 1, (22) 

where N is even to take advantage of the noninteger delay. 13 An il- 
lustrative example of an JV = 32 sample differentiator is shown in 
Fig. 9. This figure shows the impulse response, magnitude response, 
and the error curve. The peak error, 8, is approximately 0.0057. 

One could also consider designing optimal relative error filters by 
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Fig. 9 — The impulse response, frequency response, and error curve for a 32- 
point differentiator with optimal equiripple error. 
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changing the design equations slightly. For example, to design an 
optimal relative error differentiator requires, 

-&) g | H{e iaT ) - H(e iaT ) | ^ 8u (23) 

(i.e., the envelope of the error in approximation is linear with frequency 
because the desired frequency response is linear in frequency). An 
example of an N = 32-point differentiator designed in this manner 
is shown in Fig. 10. The peak error, 5, is now 0.0062, only slightly higher 
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Fig. 10 — The impulse response, frequency response, and error curve for a 32- 
point differentiator with optimal equiripple relative error. 



than 5 in the optimal error solution. The linearity of the error envelope 
is evident in Fig. 10. 

To illustrate further the versatility of the linear programming ap- 
proach, a special purpose filter for use in a digital transmission system 
was designed. 14 The specifications of the filter were: 
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F, = 112 kHz 
Passband ripple, 
Stopband ripple, 



0g/|2 kHz, 
14 ^ / ^ IS kHz, 
30 ^ / g 34 kHz, 
46 ^ / £ 50 kHz, 



20 log,,, (1 + 6.) ^ 0.25 dB 
20 log 10 8 2 ^ -63 dB 
20 log.o 5 2 ^ -63 dB 
20 1og, 5 2 ^ -63 dB 



In all other frequency bands, the frequency response was not specified. 
As an additional constraint on the impulse response, N was chosen 
arbitrarily to be 21 samples. 

Since the filter was completely constrained by the above specifications, 
it was of interest to see how close the designs could get to the desired 
specifications. A linear program was written which allowed 8 X and 5 2 
to vary. The results of this program are plotted in Fig. 11. This figure 
shows a plot of 20 log 10 (8 2 ) versus 20 log 10 [(1 + 50/(1 — 5,)] obtained 
from the program. It also shows a triangle for the desired specifications, 
and a square for the filter obtained from a manual optimization by 
S. Freeny. Although none of the filters meets the specifications, the 
computer optimized designs come much closer than the manual op- 
timization. Figure 12 shows a plot of the filter that comes closest to 
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Fig. 11— A plot of the tradeoff relations between 20 log, ((1 + «i)/(l - &i)) 
and 20 logio 5< for a lowpass filler for a digital transmission system. 
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jrjg 12 — The frequency response for the closest approximation to the desired 
specifications for the lowpass filter for the digital transmission system. 

the desired specifications. The in-band response differs from specifica- 
tions by about 0.1 dB, and the out-of-band response meets specifications 
by over 1 dB. The error is equiripple in each of the out-of-band regions. 

IX. DESIGN OF FILTERS WITH SIMULTANEOUS CONSTRAINTS ON THE TIME 
AND FREQUENCY RESPONSE 

The design of digital filters which approximate characteristics of 
a specified frequency response only has been discussed. Quite often 
one would like to impose simultaneous restrictions on both the time 
and frequency response of the filter. For example, in the design of 
lowpass filters, one would often like to limit the step response overshoot 
or ripple; at the same time maintaining some reasonable control over 
the frequency response of the filter. Since the step response is a linear 
function of the impulse response coefficients, a linear program is capable 
of setting up constraints of the type discussed above. Consider the 
design of a lowpass filter (iV odd) with specifications: 



Passband 



(iv-n/2 
1 - Si ^ /io + S 2h n cos wnT £ 1 + fti i 



(24) 



Stopband 
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(AT-D/a 



Step Response 

-8 3 ^g n ^8 3 n= "(^ Li ) , ■•■ , -(^y 2 ) + ffi . ( 26 ) 

where /t n is the symmetric impulse response of the filter (h n = h. n , 
n = 0, 1, • • • , (N — l)/2), g n is the filter step response defined by 



9n = 



\ 2 / ) (27) 



t— (Ar-i)/a 



:iv - 1 

n < - 



and A^i is the number of samples of the step response being constrained. 
For optimization there are several alternatives which are possible. 
One could fix any one or two of the parameters 5 L , 5 2 , or 5 3 and min- 
imize the other (s). Alternatively one could set 5i = a, 5, 5 2 = a 2 5, 
and 5 3 = a 3 8 where a, , a 2 , and a 3 are constants, and simultaneously 
minimize all three deltas. 

To demonstrate this technique, a lowpass filter with N = 25 and no 
constraint on 5 3 was designed. This design is an optimal filter as discussed 
earlier, and is shown in Fig. 13. In this case 8i is set to 255 2 and the 
optimization gives 8 3 = 0.12, ^ = 0.06, and 5 2 = 0.00237. The results 
of setting 8 3 = 0.03 and then minimizing the frequency ripple are 
shown in Fig. 14. The equiripple character of the frequency response 
has been sacrificed in order to constrain the peak step response ripple. 
The ripple values for this new design are 8i = 0.145 and 8 2 = 0.00582. 
Using this linear programming technique, one can obtain tradeoffs 
between any of the deltas to get a design best suited to the particular 
application. The filter of Fig. 14 was designed for smoothing char- 
acteristic speech parameters where step response overshoot is a very 
important perceptual parameter. 

X. DESIGN OF TWO-DIMENSIONAL FIR FILTERS 

The techniques of FIR filter design using linear programming are 
readily extendable to two or more dimensions. 15 Filters of both the 
frequency sampling type and optimal type have been designed in this 
manner. 
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Fig. 13 — A plot of the step response and frequency response of an optimal equi- 
ripple lowpass filter. 



XI. COMPUTATIONAL CONSIDERATIONS 

Since one of the major aspects of digital filter design by optimization 
procedures is the amount of computation necessary to produce a 
desired result, it is worthwhile discussing some of the details of our 
simultations. 

The programs used throughout this study are APMM, 16 an IBM 
scientific subroutine which computes a Chebyshev approximation of 
a given real function over a discrete range, and MINLIN, a program 
written at Bell Laboratories by Mrs. Wanda Mammel. The running 
time of these programs is highly dependent on the number of variables, 
L, the number of inequalities, P, and the "complexity" of the results 
which determines the number of iterations required to attain a solution. 
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Fig. 14 — A plot of the step response and frequency response for a lowpass filter 
with simultaneous constraints on both the time and frequency response. 



The time per iteration is approximately proportional to JlP. Typical 
experience indicates that it takes on the order of ten seconds to design 
the frequency sampling filters discussed earlier (i.e., L ^ 3, P on the 
order of 1000). The total range of times to design optimal filters using 
APMM on the Honeywell 645 computer is shown below. 

N No. Iterations Total Time 



25 


27 to 58 


14 to 47 seconds 


49 


53 to 82 


117 to 194 seconds 


99 


128 


1200 seconds 



Although the computation time is reasonably high, it is not impractical 
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to design high order filters with this technique. The argument can also 
be made that the most important application of these techniques is 
in the designs of FIR filters with small values of N (i.e., N ^ 50) in 
which case the computation time starts becoming more reasonable. 

XII. CONCLUSIONS 

The design of linear phase FIR digital filters is shown to be a linear 
programming problem, and many appropriate problems can be solved 
using this technique. Examples have illustrated several filter areas 
which are reasonable candidates for linear program designs. 
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